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(57) ABSTRACT 

Traffic demands arc routed across links of an information 
network so as to avoid congestion and allow for future traffic 
growth. Traffic demands from a source node to a destination 
node of the network are monitored, including bandwidths 
associated with each of the demands. For each demand, and 
for a given link of the network, that portion of the bandwidth 
associated with each traffic demand which is provided by the 
given link, is determined. A maximum value of link utili- 
zation among all links of the network is then determined, 
wherein link utilization is defined as the amount of band- 
width used by all traffic demands routed through a given link 
with respect to a total capacity of the link. Traffic demands 
are then routed across the links of the network in such a 
manner as to minimize the maximum value of link uliUza- 
tion. 

26 Claims, 5 Drawing Sheets 
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FIG. 1 
THE "FISH PROBLEkT 
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FIG. 5 
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MANAGING CONGESTION AND 
POTENTIAL TRAFFIC GROWTH IN AN 
INFORMATION NETWORK 

CROSS REFERENCE TO RELATED 
APPLICAnON 

This application claims the priority of U.S. Provisional 
ApplicatioD No. 60/125,603 filed Mar. 19, 1999, and entiUed 
"hiteract Traffic Engineering: Theory and Algorithms". 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to schemes for managing traffic 
flow in an information network. 

2. Discussion of the Known Art 

Recently, network traffic management has become an 
important subject. For example, dramatic increases in back- 
bone network speeds require precise control over internal 
network traffic distribution. Yet, Internet Protocol (IP) traffic 
routing is based typically only on a destination address, and 
on simple metrics such as bop-count or delay. See C. 
Huitema, Routing in the Internet, Prentice Hall (1995). 
Although the simplicity of this routing approach is scalable 
to very large networks, use of resources within Internet 
backbone networks currently tends not to be optimal. A 
destination-based, shortest-path routing approach often 
results in uneven traffic distribution and, sometimes, in route 
oscillations. 

Recent developments, such as Differentiated Services, 
Multi-Protocol Label Switching (MPLS), and Virtual Pri- 
vate Networks (VPNs), necessitate greater traffic engineer- 
ing capabilities in Internet backbones. Under the differenti- 
ated services model, data packets are policed on a network 
edge, and forwarded based on only a DS field within the 
core. See S. Blake, et al., An Architecture for Differentiated 
Services, RFC-2475, IETF (December 1998). This approach 
relies heavily on effective traffic management to provide 
such resource allocations as needed to meet an existing 
service level agreement (SLA). Users are now considering 
IP VPNs for interconnection between different intranet user 
sites, and traffic must be handled to meet performance 
guarantees for virtual leased fines. 

Multi-Protocol Label Switching (MPLS), recently devel- 
oped by the Internet Engineering Task Force (IETF), pro- 
vides essential capabilities for explicit routing in the Inter- 
net. See A Viswanathan, et al., Evolution of Multiprotocol 
Label Switching, IEEE Communications, May 1998, all 
relevant portions of which are incorporated by reference. 
MPLS label distribution proU)cols can be used to set up 
explicit routes that differ from those provided by typical 
destination-based routing procedures. An originator of an 
explicit route can compute, based on optimization 
objectives, some or all nodes that will form the explicit 
route. Within an IP layer in a network, a MPLS explicit route 
is simply a point-to-point logical connection. Any packets 
sent onto a MPLS explicit route will travel to the other end 
of the route. Forwarding of packets over an expUcit route is 
based on the MPLS labels, thus requiring no IP layer 
processing. 

There are currently two protocols in MPLS for establish- 
ing label-switched paths (LSPs), and both of them support 
explicit routes. In addition, the MPLS label distribution 
protocols also permit Quafity of Service (QoS) attributes to 
be specified. Thus, MPLS label distribution protocols can be 
used to set up a virtual private network (VPN) with expUcil 
routes and bandwidth guarantees. 
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Although the MPLS expfidt route approach has great 
flexibility, it requires a full-mesh logical network to be 
established between all edge nodes. While this is feasible for 
most reasonable size backbone networks, management com- 

5 plexity and messaging overheads can rise substantially when 
the number of edge nodes increases. 

Topological routing problems have been considered along 
with assignments of link capacity (network sizing) for 
optimization of network resources. See T. Ng, et al., Joint 

10 Optimization of Capacity and Flow Assignment, IEEE 
Transactions on Communications, COM-35:202-209 
(1987); M. Gerla, et al.. Topology Design & Bandwidth 
Allocation in ATM Networks, IEEE Journal on Selected 
Areas in Communication, 7:1253-1262 (1989); and M. Lee, 

15 et ai., A Logical Topology & Discrete Capacity Assignment 
Algorithm, Operations Research, 43:102-116 (1995). 

A conventional approach is to choose average packet 
delay as a minimization objective, which results in a non- 
linear objective function under some queuing assumptions. 
The optimization problem is then formulated as a nonlinear 
multi-commodity network flow problem. See D. Bertsekas, 
et al., Data Networks, Prentice Hall (1987), Because of the 
nonlinear objective function, the optimization problem 
becomes very difficult to solve. Many heuristic approaches 

^ have been proposed, such as a flow deviation method and a 
proximal decomposition method. See L. Fratta, et al.. The 
Flow Deviation Method, Networks, 3:97-133 (1973); and J. 
Chiffet, et al., Proximal Decomposition for Multicommodity 
Flow Problems, Telecommunications Systems, 3:1-10 

^° (1994). 

A rerouting heuristic algorithm is proposed in L. 
Bemnohamed, et al.. Designing IP Networks, Bell Labs 
Technical Journal (December 1998) for a classical network 

2^ loading problem (linear objective function) with cost mini- 
mization in the context of IP networks, which exphcitly 
considers restrictions imposed by the known Open Shortest 
Path First (OSPF) routing protocol. Another related area is 
Quality of Service (QoS) routing. Schemes have been pro- 
posed to find a path under multiple constraints. See Z. Wang, 
et al., Quality of Service Routing For Supporting Multime- 
dia Communications, IEEE JSAC (September 1996); Q. Ma, 
et al.. Routing Traffic with QoS Guarantees, NOSSDAV'98 
(UK 1998); and R. Guerin, el al., QoS based routing in 
networks, Infocom'97 (1997). The proposed QoS routing 
schemes are typically "greedy", however, in that they try to 
find a path that meets a particular request without consid- 
ering potential network-wide impacts. 

Because of the commercial and competitive nature of 

50 Internet services, ISPs must always improve the perceived 
quahty of network services by reducing delay and packet 
losses, and by increasing throughput experienced by end 
users. ISPs must meet their performance objectives and, at 
the same time, maintain a high level of resource utilization 

55 to maximize return of their investment in network assets. 

SUMMARY OF THE INVENTION 

According to the invention, a method of managing traffic 
flow across links of an information network includes moni- 

60 to ring traffic demands from a source node of an information 
network to a destination node of the network, including 
bandwidths associated with each of the traffic demands, and 
determining, for each traffic demand, and for a given link of 
the network, that portion of the bandwidth assodaled with 

65 each traffic demand which portion is provided by the given 
link. A maximum value of hnk utilization among all links of 
the network is determined, wherein link utilization is defined 



06/22/2004, EAST Version: 1.4.1 



us 6,724,722 Bl 



as the amount of bandwidth used by all traffic demands 
routed through a given link with respect to a total capacity 
of the link. The traffic demands are routed across the links 
of the network in such a manner as to minimize the maxi- 
mum value of link utilization. 

For a better understanding of the invention^ reference is 
made to the following description taken in conjimction with 
he accompanying drawing and the appended claims. 

BRIEF DESCRIPTION OF THE DRAWING 
In the drawing: 

FIG. 1 is a graph of a network showing two sets of links 
within the network that form a path between a source and a 
destination node of the network; 

FIG. 2 is a representation of a backbone network; 

FIG. 3 is a table of results for tests performed on a 
simulated network according to FIG. 2; 

FIG. 4 is a graph which compares results obtained using 
trafi&c routing approaches according to the invention; 

FIG. 5 is a graph showing results obtained using online 
traffic routing techniques according to the invention; and 

FIG, 6 is a flow chart illustrating network traffic routing 
according to the invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

One approach toward optimizing network performance is 
to manage the use of bandwidth by routing the traffic over 
selected links in the network. Poor resource utilization in 
current networks may be illustrated by a so-called "fish 
problem". See FIG. 1. 

The topology in FIG. 1 bears some resemblance to a fish, 
where G is the head, and A and B form the tail. Although 
there are two paths from the tail to the head (path C-D-F, and 
path C-E-F), all traffic from A and B to G is routed over only 
one of the two paths. This typically leads to extremely 
unbalanced traffic distribution; one path may be heavily 
loaded while the other remains idle. . 

The fish problem is caused primarily by two properties of 
current Internet routing protocols. First, the current proto- 
cols use destination-based shortest paths with simple link 
metrics. For a given destination, usually only one path meets 
the given criteria. Therefore, the protocols arc not able to 
route traffic so as to balance loads over multiple paths to the 
same destination. Second, even if equal -cost multiple paths 
are available, the cunent routing protocols do not take full 
advantage of them because the protocols perform only a 
local optimization for a current demand, without considering 
possible impact on resource contention with other (future) 
demands. 

Although network congestion can be reflected by peri- 
odical link state updates, it is known that local optimization 
based on periodical link state changes may lead to route 
oscfllation. Using the topology in FIG. 1 as an example, 
assume a routing protocol initially selects C-D-F as a 
shortest path from C to F. As all traffic is routed over this 
path, it becomes heavily congested while the other path 
C-E-F is idle. At the next routing update, the routing 
protocol decides that path C-E-F is better, and selects it as 
a current-shortest-path from C to F. But all existing traffic is 
now moved from path C-D-F to path C-E-F, so path C-E-F 
becomes congested while at the same time path C-D-F 
becomes idle. The path selection is reversed in the next 
routing update, and the process goes on indefinitely. 



The fish problem thus becomes one of route optimization. 
That is, given a network topology, link bandwidths, and 
point to pomt traffic demands between all edge nodes of a 
network, how should each newly arriving demand be routed 
across the network such that no one link capacity is 
exceeded and a pre-defined objective is optimized. 

Typically, two factors contribute to network congestion. 
First, congestion may simply result from inadequate net- 
work resources. Traffic demands simply far exceed those 
10 which the network can accommodate; i.e., all network 
resources are highly utilized. Second, poor traffic distribu- 
tion may also cause congestion at some parts of the network. 
If traffic is distributed in an unbalanced manner across the 
network, some links in the network may be overloaded while 
other links remain underutilized. 

The problem of inadequate network resources may be 
addressed either with better network provisioning, or by 
reducing and controlling demands. Poor traffic distribution, 
however, may be addressed by the approaches or procedures 
described below. From a perspective of performance 
optimization, it is desirable to ensure that subsets of network 
resources do not become over utihzed and congested, while 
other subsets along alternate, feasible paths remain underuti- 
lized. Ideally, all network links should be utilized to the 
same level. Because queuing delay increases non-hnearly 
and at a faster rate as link utilization increases, a worst-case 
delay bound tends to increase when traffic distribution is 
unbalanced. As mentioned earlier, ISPs must keep maximum 
link utilization as low as possible. 

Minimizing the maximum of link utilization will ensure 
that traffic is directed away from congested "hot spots" to 
less utilized parts of a network. This approach also leaves 
more room for future traffic growth than the other schemes 
noted above, and the percentage of residual bandwidth on 
links (unused bandwidth) is also maximized. Thus, future 
traffic growth is more likely to be accommodated. This is 
especially true assuming that network traffic grows in pro- 
portion to a current traffic pattern (i.e., scale up). 

Problem Formulation 

A backbone network is modeled as a set of nodes con- 
nected by links, each link having a fixed capacity 
(bandwidth). Edge, nodes arc those that connect to custom- 

45 ers' networks and to other backbones. Assimie that the 
average traffic demand from one edge node to another is 
known. This demand can be measured by ISPs, or in the case 
of VPNs, specified by customers as the bandwidth require- 
ment for two nodes. The physical network is represented as 

50 a directed graph. The links in the network and their capaci- 
ties are directional, i.e., link (i j) is considered different from 
link (j,i), each with its own capacity. Traffic demand between 
two edge nodes is also directional, i.e., the demand from 
node s to node t is different than that from node t to node s. 

55 The problem to be solved is to route traffic demands 
between edge nodes over a physical network topology such 
that all the traffic demands are fulfilled, no physical Unk 
capacity is exceeded, and the maximum of Link utilization is 
minimized. Let a graph G=(V,E) represent the physical 

60 network, where V is the set of nodes and E is the set of links. 
For each link (ij)eE, let c,y be the capacity of the link. Let 
K be the set of traffic demands between a pair of edge nodes. 
For each keK, let dj^ s^^, t^^ be the bandwidth demand, the 
source node, and the destination node, respectively. Also, for 

65 each link (i j)eE, and for each demand keK, let X*^- represent 
the percentage of k's bandwidth demand provided by tink 
(i j). Let a represent the maximum of link utilization across 
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all the links. A linear programing formulatioa for the opti- scheduled time, e.g., nightly. In this case, the demands and 

mization problem may then be given as follows: topological information can be used as inputs to a traffic 

management system, and the routes calculated by solving 

Linear Programming Formulation (LPF) the LPF. The results are then used lo set up explicit routes 

s for the demands. If a demand must be split over multiple 
routes, the edge node that originates the explicit route must 

niiii a (1) be configured to perform load sharing over the multiple 

^^ (2) '""i" potential problem with this approach is that each 

Tj,^ij^,/-ij.^^i^/''iMKi'^k (3) scheduled update may disrupt aU previously established 

^ routes, and frequent updating may generate unacceptable 

i^^tj ^c,ja,(i,jyE (4) messaging overheads. Thus, the offline mode should be 

o^/^i,a^o invoked over relatively long time intervals, rather than on a 

per-call basis. 

The objective function (1) defines the variable to be jhe second operating mode is an on-line mode. If 

minimized as the maximum of link utilization. Constraints demands are added and are deleted fi-equently, an incremen- 

(2) and (3) are flow conservation constraints. Equation (2) tai approach is more desirable. For example, when a demand 

maintains that traffic flowing into a node must equal the is created as a result of a new VPN being added to a network, 

traffic flowing out of the node, for any node other than a new explicit routes are established for these demands, and 

source node and a destination node for a given demand. gJl previously routed logical connections will remain 

Equation (3) defines the net flow out of a source node as 1, unchanged. This approach will therefore minimize potential 

which is the total required bandwidth after being scaled by impacts on the operation of a given network. 

d;t. Constraint (4) is a link capacity utilization constraint. It pi^e heuristic, on-line routing procedures that can be used 

maintains that the total amount of bandwidth consumed by ^j. incremental approach, are now presented. These 

all logical connections on a fink, should not exceed the ^ schemes do not assume knowledge about an entire demand 

maximum utilizaUon rale times the total capacity of the link. 5^^, and they ensure that demands are not split over multiple 

The last constraint restricts aU the variables to non-negative ^^^^^^ Performance of these schemes relative to an optimal 

real numbers, and the X ,^ vanables to be no more than 1. solution by the LPF, is examined later below. HG. 6 

The above LPF can be solved by standard packages (e.g., illustrates dynamic network traffic routing according to the 

CPLEX), and the resulting solution produces optimal routes invention 

for aU demanck. As shown below the IJF results c^n be ^^^^ ^ ^^^^^y^ lopology, its link capacities, 

implemented both with MPLS-based and OSPF-based ^^p^^j ^^^^ ^^^^ ^^^^^ previously placed, are 

approacnes. , , . known. No knowledge about future demands is assumed, 

A demand between two edge nodes may be split over however. All of the procedures, except minimum hops (MH) 

multiple routes. Suppose m FIG. 1 that the demand between 35 ^^^^^^ ^ ^j^j^ ^ink state can be measured either 

node A and node G is x. An optimal routmg solution ^^ ^^^y^^j ■ by link utilization (the ratio of used 

produced by the above LPF tnay require <^^o routes to be set ■ ^^ ^^^^^ capacity). Link utilization is a better indi- 

up for the demands (A-C-E-F-G and A-C-D-F-G), and the ^^^^^ ^^^^ ^^solute residual capacity for traffic delay. In 

^'""^ ,x ^ T u ^ addition, it offers better optimization performance. Numeri- 

(e.g 2:3) This requires edge nodes such as node Cm FIG. ^ experiments performed show that link sUte sensitive 

1 to be able to perform load sharing over midUple paths. For that use link utUization as a metric, perform 

ofQme routmg, assume that load sharmg is feasible because sig^canlly better than procedures which use absolute 

ttme constramts are not important, and the fact that point- ^^^y^^j ■ ^^^^^ ^^^^ insensitive, 

to-pomt demands are in the form of aggregated traffic flows Herefore, except for minimum hop, all the following pro- 

or stabstical averages. For onhne rouUng, however, it may ^^^^^^ ^ utilization-based metrics, 

be difficult to split mdividual demands oplimaUy on a ^ ^^^^^ p^,^ ^^p^ Minimum Hops (MH) 

dynamic basis, so it is assumed that placmg each demand Although shortest-path routing procedures are generally 

over a smgle route is better from an operational perspective. ^^^^ .^ ^ ^ ^ 

Assuming all demands are known, a mathematical for- present shortest path routing approach in the 

raulation for the case where each demand must be routed ^^^^^ optimization objective, i.e., 

over a single path may t^e lie form of the above LPF, with ^^^i^^^ ^.e maximum of link utilization. Tlie cost metric 

an additional restnct.on that the X\. vanables must be either fo, ^^^^^^ ^^ ^--y ^ ^i^^i^^d as a V(f*tf+ 

0 or L The opumization problem then becomes aninteger ^^^^^ j* ^^g^, (excluding current 

programming one, and it is known to be NP-hard. The LPF ^^^^^ j j^^the size of the current demand k, and c., is 

solution wm provide a lower bound to any onlme rouUng 55 thetotalcapacity of the link. ExpUcit routes are then selected 

procedure that is used to optmiize traffic routmg wilhm a ^y choosing the path with the minimum cost, 

network. ^ variation of shortest path routing is minimum bop 

MPLS-Based Anoroach routing. In this case, the link metric is set to 1 uniformly, and 

the shortest path procedure will always choose the path 

A MPLS explicit route is simply a point-to-point logical 50 which has minimum hops, 

connection from the peispective of an IP layer, any packets 2. Shortest-Widest Path (SWP) 

sent onto a MPLS explicit route will follow through to the with shortest-widest path routing, paths with the largest 

other end. Thus, once the LPF produces optimal routes for bottleneck bandwidth are selected, wherein the bottleneck 

all demands, available techniques can be used to set up bandwidth of a path is the minimum idle capacity across all 

corresponding MPLS-explicit routes within a network. {$ the links on the path. If there are multiple candidate paths. 

The setup can operate in either of two modes. First, in an the path with minimum hops or the shortest distance is 

offline mode, the routes for all demands are updated at a chosen. Further details of such routing in a QoS context to 
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support bandwidth reservatioa, may be found in Z. Wang, et 
al., Quality of Service routing for Supporting Multimedia 
Communications, IEEE JSAC (September 1996); Q. Ma, et 
al., Routing TraflSc with Quality of Service Guarantees in 
Integrated Service Networks, NOSSDAV'98 (UK 1998); s 
and R. Guerin, et al., QoS Based Routing in Networks with 
Inaccurate Information, INFOCOM *97 (1997), all relevant 
portions of which are incorporated by reference. 

The present approach incorporates a variation of shortest- 
widest path routing wherein the percentage of link idle 
capacity, not the absolute amount of idle capacity, is used. 
That is, the path is computed such that the resulting maxi- 
mum of link utilization of all the hnks on the path, is 
minimized. This variation performed best in tests that were 
performed, as described below. 

3. Min-Max Link Utilization (MM) 

A routing technique based on a link cost metric which 
closely resembles the optimization objective of the LPF, 
above, now follows. The technique keeps track of a, the 
current maximal link utilization value, across all the hnks all 
the time. Before a current demand k is routed, let a* be the ^ 
global maximal link utilization, a*y be the utilization of link 
(ij), and t*,y=d/c^y be the incremental utilization of link (i,j) 
caused by demand k, i.e., a* ~f^,y/c,y and a^^^max^ya^y. The 
notation here is the same as used above. 

The cost metric for Unk (ij) for demand k is defined as 
a^ «max a*y4t^,y-a*, 0+et^y. The first term is the increase of 
the global a caused by link (ij) if, after loading demand k, 
its utiUzation exceeds the current global a, and 0 otherwise. 
The second term is a noicc term for breaking ties where e is 
a very small scalar. The only time the second term is 
significant is when multiple paths exist having an identical 
minimum impact on the global a. In this case, the path with 
the total accumulated resource (utilization) consumption is 
chosen. A difference between this and the shortest- widest 
path procedure is that this procedure takes the shortest 
(utiHzation) path as long as network bottlenecks can be 
avoided, while the shortest widest path approach may end up 
with a longer path which is "widest". 

4. Hybrid 

The shortest path based procedures minimize total ^° 
resource consumptiori per demand, as they select a minimal 
cost path. But the optimization is local in the sense that it 
does not consider other and future demands on the network. 
As an example, taking a longer path for a current demand 
may consume more bandwidth in the extra hops. But such a 
route would leave more residual bandwidth at critical bottle- 
neck links in view of anticipated future demands. 

The widest path and Min-max link utilization based 
approaches tend to avoid overloading any bottleneck links 
by taking longer paths. These extra hops, however, may not 
always be necessary given the fact that any pattern future 
demands may establish is unknown, and, theoretically, any 
scenario may occur. 

By examining a tradeoff between avoiding botdeneck 
hnks and taking longer paths, a hybrid approach which 
balances the two objectives by assigning them appropriate 
weights, is now given. Using the same notation as above, 
define a hnk cost metric as 

where h* is the number of hops of a min-hop path for 
demand k. The cost metric includes two terms. The first can 
be viewed as an enhanced version of the incremental Unk 
utilization metric used in the shortest path approach (SP). 
The difference is the extra multiplier t*^. which can be 65 
interpreted to imply that if two links have the same 
utilization, the one with larger capacity is selected. 
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The second term is the impact to the global a, which is the 
same metric xised in the Min-max utilization procedure. Two 
multipUers are applied for the second term, viz., h* and a*. 
The reason is as follows. Longer paths (as measured by h*) 
can be more affordable than shorter paths if extra hops along 
those paths are taken to avoid bottlenecks. The weight of the 
second term therefore increases with path length h*. The 
second term should be less important initially when the 
network is relatively empty (no bottlenecks), and becomes 
more important as the network becomes loaded, a* is such 
an indicator. Once the cost meu-ic is defined for each link, 
the demand is routed along the shortest path based on this 
new link metric. 

Open Shortest Path First (OSPF)-Based Approach 

While the above MPLS -based approaches can be imple- 
mented relatively easily, they do incur an "N-square" prob- 
lem. That is, to establish logical connections between N edge 
nodes, at least N^ explicit routes are needed. And ff demands 
are split over multiple routes, the number of explicit routes 
may be even larger. As the size of a backbone network 
increases, the number of explicit routes that need to be 
established will rise significantly, adding considerable man- 
agement complexity and messaging overhead. For example, 
for a network with 20 PoPs wherein each PoP has 10 edge 
nodes, 40,000 explicit routes wUl need to be set up. 

A desired traffic distribution may be achieved, however, 
by manipulating the link weights in OSPF. Optimal routes 
are obtained first by solving the above LPF, and then 
defining the link weights so that OSPF achieves the identical 
optimal traffic distribution by performing typical shortest 
path calculations. That is, by adjusting the hnk weights, 
optimal traffic routing which until now was thought possible 
only by using explicit routing protocols like MPLS, can be 
achieved. 

This approach has a number of advantages. First, it can be 
readily implemented without requiring an upgrade of the 
network infrastructure. OSPF is currently widely deployed. 
And, once the Unk weights are set, then OSPF apphes typical 
computations. Second, it eliminates the "n-square" problem 
altogether, thus reducing messaging overhead in setting up 
exphcit routes. Finally, the approach can be implemented 
within, current IP datagram routing and forwarding 
protocols, so it retains the simplicity and scalability of IP 
routing. The approach requires equal-cost multi-path 
capability, which is supported by OSPF. 

A method of calculating the link weights so that OSPF 
will produce a set of routes that achieve a desired traffic 
distribution, is now described. The approach makes use of 
the linear programming duality theory. See V. Chvatel, 
Linear Programming, W. K, Freeman & Co. (1983), all 
relevant portions of which are incorporated by reference. 
Each linear programming problem (P) is associated by 
another linear programming problem (D). (D) is called the 
dual problem of (P) and (P) itscff is called the primal 
problem. (P) is in turn the dual of (D). (P) and (D) are 
mathematically equivalent in the sense that they have the 
same optimal objective value, and the optimal solution of 
(D) can be derived from the optimal solution of (P) and vice 
versa by the relationship of complementary slackness. The 
variables in (D) can be interpreted as the shadow prices for 
resource constraints in (P). 

For demand k, let s^^ and t^j. be the source and the 
destination edge nodes, {U*-} be the shortest distance from 
the source node s^^ to node i for each -node i, and {W^y) the 
weight for link (i,j). Then the dual of the LPF is given as 
follows: 
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Dual formulation (DPF) procedure starts, it is mathematically equivalent to using 

only the residual (idle) link capacity and viewing the net- 
work as being empty. 

max r^tL/,/ (6) pjQg 4 and 5 are plots of performance curves of the five 
if u^-Uf^^WrMK {ij)€£ (7) ^ Online routing procedures, as weU as the optimal solution of 

' ' ' the offline LPF formulation. Here, performance is measured 

2(ij')<£c^f^(ri» (8) by ultimate maximum link utilization across the entire 

network as a result of routing by each procedure. FIG. 4 

^(^^0,1/,^ «o (9) shows a significant difference between the min-hop proce- 

m. T^nr^ i_ i_ i j ^ • ^- 1 1- i dure and the othcrs. FIG. 5 comoarcs thc performancc of all 

The DPF, above, may be solved to obtam an optimal unk other roccdures 

weight set {W^- }. This set of link weights will make the ^ 

optimal routes determined by (LPF) the shortest paths. The following obscrvaUons arc made from the test results. 

Based on the optimal set of link weights, there may be ^^^U the min-hop approach is the only link state insen- 

multiplc<qual cost shortest paths between the same edge sitive procedure among those evaluated, and it was outper- 

node pair that are likely candidates for load balancing. formed greaUy by the others. 

Therefore, the primal problem (LPF) may then be solved to Second, link utilization is a good indicator of link state, as 

determine just how traffic should bib split, if at all, among procedxires based on link utilization outperform those based 

multiple equal cost shortest paths as determined by the link on absolute values of residual capacities (the results are not 

weights {W,y}. shown in the drawing). 

Third, among the four link utilization based approaches, 

EXAMPLE jjje hybrid approach shows best performance, but differences 

To evaluate the performance of the present procedures in ^^^^ approaches are not significant, 

a realistic setting, a network topology similar to one of the Fourth, the performance of the four link utilization based 
largest Internet backbones in the United Stales was used. 25 procedures matches very closely that of the optimal LPF 

The network has 54 nodes and 174 directional links, as soludon. Note that the LPF solution is optimal for the case 

represented in FIG. 2. where demands can be split. The optimal value for the 

For the given network topology, the link capacities are non-splitUng case may in fact be higher than the LPF 

generated as random numbers with a uniform integer dis- ^ ^^^^^ ^ "^^'^^y ^ 1°^^^ ^ound for 

tribution in [600, 1400]. Ten test sets were constructed, with the dynamic routmg problem. 

the number of demands varying from 300 to 1200 in ^i^ti, the performance of the four link utiHzation based 

increments of 100. The size of each individual demand is procedures as measured by the gap with the optimal LPF 

generated by a random variable with a uniform integer solution, does not degrade as the number of demands grows, 

distribution in [1, 10]. The source and the destination pairs While the foregoing description represents preferred 

are also selected randomly among all edge nodes, although embodiments of the invention, it will be obvious to those 

all duplicate pairs are removed. skilled in the art that various changes and modifications may 

AU quantities are specified in a common bandwidth unit n^^de, without parting from the spirit and scope of the 

(such as DSl). The exact value of the bandwidth unit and the invention pointed out by the foUowing claims, 

overall size of the total link capacities vs. total bandwidth claim: 

demand do not affect the results; i.e., the problem formula- 1- ^ method of managing traffic flow across links of an 

tion uses link utilization as an objective which operates as a infonnation network, comprising: 

scalar. The number of demands, the total bandwidth of all monitoring traffic demands from a source node of an 

demands, and the total bandwidth of all link capacities in the information network to a destination node of the 

network, are summarized in the table of FIG. 3. network, including bandwidths associated with each of 

The maximum of link utilization a should not be larger the traffic demands; 

than 1 if all demands are routable. In the tests performed, determining for each traffic demand and for a given link 

however, a may be larger than 1. This indicates that the of the network, that portion of the bandwidth associated 

network does not have sufficient bandwidth to meet all with each traffic demand which portion is provided by 

bandwidth demands. In fact, a represents precisely a level of the given link; 

over-booking at the bottlenecks. To lower the maximum of determining a maximum value of link utilization among 

link utilization to 1 , either the bottleneck link capacities are all links of the network, where link utilization is defined 

scaled up by a factor of a, or the bottleneck demands are as the amount of bandwidth used by all traffic demands 

scaled down by a factor of a. routed trough a given link with reject to a total 

All computations were carried out on a SUN SPARC 10 55 capacity of the link; 

workstation. Optimal LPF solutions were first obtained for calculating a cost metric for each link of the network 

all 10 lest sets by solving them as centralized Uncar pro- based on infonnation comprising the traffic demand 

gramming problems. First, the solutions are the optimal and maximum value of link utilization; 

solutions for offline routing problems. Second, they provide selecting a path that minimizes the maximum value of 

lower bounds for online routing procedures. The computa- eo link utilization based on each cost metric; and 

tions took no more than a few minutes for aU cases. routing the traffic demands across the path. 

The computations were then simulated for the five online 2. The method of claim 1, further comprising routing 

routing procedures using the same configuration. The only traffic demands over more than one path in the network, 

difference being that an order of routing the demands must 3. The method of claim 1, further comprising routing each 
be predetermined. Random sequencing was used. Another 65 traffic demand over a single path in the network, 

assumption was that initially the network was empty. If there 4. A method of managing traffic flow across links of an 

is existing traffic in the network before an online routing information network comprising: 
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receiving a demand to route network traflBc; selecting a path that minimizes the maximum value of 

determining a demand size of the demand; link utilization based on each cost metric; and 

determining a routing procedure associated with the routing the trafBc demands across the path. 

demand; ^ 15, The computer readable medium of claim 14, including 

calculating a cost metric for each of a plurality of links of instructions further comprising routing traflSc demands over 

a network; the cost metric for each link being associ- more than one path in the network. 

atcd with information comprising the routing procedure 16 . The computer readable medium of claim 14, including 

and a link uUUzation, the link utilization being a ratio instructions further comprising routing each traffic demand 

of link capacities; and ^^^^ ^ ^^^^ p^^j^ ^ ^^^^^^ 

selecting a path to route network traffic based on the 17 ^ computer readable medium including computing 

calculated cost metric for each of the pluratity of links. instructions for managing traffic flow across links of an 

5. The method of claim 4 wherein, the network traffic is information network, the instructions comprising: 
routed over a multi-protocol label switch mg network. 

6. llie method of claim 4 wherein, the routing procedure 15 r^^eivrng a demand to route network traffic; 
is a shortest path routing procedure and the cost metric is determining a demand size of the demand; 
determined by a ratio of the used link capacity and the determining a routing procedure associated with the 
demand size to the total link capacity. demand; 

7. The method of claim 4 wherein, the routing procedure 11*- * *-r uc 1 1* ^ri r 

, ^ , .J , ' J -T^i. ^ calculatmg a cost metric for each of a plurality of hnks of 

is a shortest-widest path routing procedure and the cost on * 1 »u * * • <• i. i- 1 1. • 

, , . ... ... . r 1- , -Ji a network; the cost metric for each link heme assoa- 

metric is associated with a percentage of link idle capacity. r . - • . • . 

8. The method of claim 7 wherein, if there are multiple /"fo^at.on compnsmg he touting procedure 
candidate paths, the path with minimum hops or the shortest """^ " utihzaUon, the hnk uldizaUon bemg a raUo 
distance is chosen. °^ c»Pa«fes; and 

9. The method of claim 4 wherein, the routing procedure 25 selecting a path to route network traffic based on the 
is a Min-Max link utilization routing procedure and the cost calculated cost metric for each of the plurality of links, 
metric is associated with a maximum link utilization of the 18. The computer readable medium of claim 17 wherein, 
link, the demand size, and link utilization of the plurality of the network traffic is routed over a multi-protocol label 
links. switching network. 

10. The method of claim 9 wherein, the cost metric is 30 19. The computer readable medium of claim 17 wherein, 
adjusted by a small scalar value and the demand size where the routing procedure is a shortest path routing procedure 
a cost metric for a link is the same as a cost metric for ^nd the cost metric is determined by a ratio of the used hnk 
another tick. capacity and the demand size to the total link capacity. 

11. Hie method of claim 4 wherein, the routing procedure ^O. Hie computer readable medium of claim 17 wherein, 
is a hybrid routing procedure and the cost mctnc IS associ- 35 the routing procedure is a shortest-widest path routing 
ated with the link uUhzaUon, the dem^md size, a maxmium procedure and the cost metric is associated with a percentage 
hnk utilization for the hnk, a number of hops of a mmunum .^^^ ^ 
hop path for the demand, and the link utilization of the r« . j l. j. ^ , • . 
nluraUtv of links computer readable medium of claim 17 wherem, 

12. Tlie method of claim 11 wherein, the selected path to 40 ^ ^^^'^ T^^^^' T"^"^"^' ^'^^ mmlmMm 
route network trafficis the shortest path. *^ops or the shortest distance is chosen. 

13. The method of claim 4 wherein, selecting the path to ^2. The computer readable medium of claim 17 wherein, 
route network traffic is based on a weight associated with the routing procedure is a Min-Max link utilization routing 
calculated cost metric for each of the plurality of links; each procedure and the cost metric is associated with a maximum 
weight being manipulated in a open shortest path first 45 link utilization of the link, the demand size, and hnk 
network. utilization of the plurality of links. 

14. A computer readable medium including computing 23. The computer readable medium of claim 22 wherein, 
instructions for managing traffic flow across links of an the cost metric is adjusted by a smaU scalar value and the 
information network, the instructions comprising: demand size where a cost metric for a link is the same as a 

monitoring traffic demands from a source node of an 50 cost metric for another link. 

information network to a destination node of the 24. The computer readable medium of claim 17 wherein, 

network, including bandwidths associated with each of the routing procedure is a hybrid routing procedure and the 

the traffic demands; cost metric is associated with the link utilization, the demand 

determining for each traffic demand and for a given link size, a maximum link utilization for the Unk, a number of 

of the network, that portion of the bandwidth associated 55 hops of a minimum hop path for the demand, and the link 

with each traffic demand which portion is provided by utflization of the plurality of links. 

the given link; 25. The computer readable medium of claim 24 wherein, 

determining a maximum value of link utihzation among the selected path to route network traffic is the shortest path. 

aU links of the network, where link utilization is defined 26. The computer readable medium of claim 17 wherein, 

as the amount of bandwidth used by all traffic demands the selecting of the path to route network traffic is based on 

routed trough a given link with respect to a total a weight associated with the calculated cost metric for each 

capacity of the link; of the plurality of links; each weight being manipulated in a 

calculating a cost metric for eadi link of the network open shortest path first network, 
based on information comprising the traffic demand 

and maximum value of link utitization; ♦ * » ♦ » 
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